1/ / Spectrum in the Information Transfer Model for Mass Extinction 
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We study the information transfer model for biological evolution with several kinds of fitness 
function. The system is stimulated to evolve into a stationary state, depending on the fitness 
function and on the dimension of the lattice formed by the species. In particular the system yields 
time series of the mutation rate which exhibits the 1/f spectrum, thus explains the power- law 
behavior in fossil data. Effects of shortcuts introduced on the lattice are also examined and the 
evolution activity is usually found to increase in a well-growing system although the reduction of 
the overall activity may also be observed in the presence of shortcuts, depending on the initial 
configuration. 
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I. INTRODUCTION 



Although it is usually believed that some extinction 
events of largest scale were caused by exogenous stresses 
such as the impact of asteroid, also observed are back- 
ground extinctions of all scales 0, 0. Recently, there 
have been attempts to explain the extinction data in 
terms of scale invariance @ ■ It is argued that the ecosys- 
tem is more or less critical, namely, the constituents are 
correlated in all scales. As a result of this, the distribu- 
tion D(s) of extinction events of size s fits to a power law, 
D(s) ~ s~ r with 1 < t < 2 4]. In addition, the lifetime 
distributions of families and genera also display similar 
power-law behavior |5( . The origin of this apparent crit- 
icality is not yet clearly resolved, for we do not know the 
dynamics of evolution sufficiently. Among many efforts 
to explain the extinctions of species as natural phenom- 
ena without resorting to external causes, there are the 
fitness landscape models 6], self-organized critical mod- 
els 0, inter-species connection models @, and environ- 
mental stress models . All of these can explain certain 
features of the fossil data, although some models may 
give more satisfactory exponents of the power laws than 
others. The successes and shortcomings of these models 
are reviewed in Refs. Hand H 

Several years ago it was suggested that the extinction 
data can be explained with the "information transfer 
model" , in which entropy plays a decisive role for ac- 
ceptance of a mutation event [Tij ■ It takes into consider- 
ation the fact that mutations are random on the molec- 
ular level whereas natural selections are performed via 
information transfer. Interestingly, the resulting dynam- 
ics has turned out to be the entropic sampling algorithm, 
which has been successfully applied to the traveling sales- 
man problem |12| . Accordingly, the information transfer 
model does not employ the extremal dynamics, which 
evolves the system by sequentially updating or mutating 
the species with the globally minimum value of fitness 
[l3|. Nevertheless, if we allow the system to evolve in 
such a direction as to decrease the entropy of the sys- 



tem, power-law behavior emerges on the phenotypic level. 
This suggests that entropy indeed plays a key role in bio- 
logical evolution and the information transfer may be the 
origin of self-organized criticality. However, there still 
lacks direct evidence for self-organized criticality; in par- 
ticular it has not been addressed whether the mutation 
rate displays a power-law spectrum. Further, it has not 
been examined how the behavior of the model depends 
on such ingredients as the fitness function, the dimen- 
sion, and the presence of shortcuts. This work studies 
the detailed behavior of the information transfer model: 
the stationary patterns of the mutation rate R(t) and the 
total fitness F(t), as well as the extinction event distri- 
bution D(s), depending on the fitness function of species 
and the dimension of the lattice. It is revealed that the 
mutation rate displays the 1/f spectrum, confirming the 
criticality of the model. In consideration of the small- 
world character, we also add shortcuts to the lattice and 
examine their effects on the evolution activity. 



II. INFORMATION TRANSFER MODEL 

For completeness, we briefly describe the information 
transfer model for biological evolution, which is essen- 
tially the Monte Carlo simulation process adopting the 
entropic sampling algorithm. Consider an ecosystem of 
N species, in interaction with the environment. The con- 
figuration of the ecosystem is described by x = 
where Xi represents the configuration of the i-th species 
and is taken to be a number between zero and unity 
(0 < Xi < 1). We assume that the fitness of the ith 
species is given by a real function fi{x), which may de- 
pend upon the configuration of its neighbors as well as 
its own configuration Xi. The total fitness F{x) is then 
defined to be the sum of the fitness values of all species 
in the system: 



N 



F{x) = Y,fi{x) 



(1) 



2 



The information-theoretical entropy S can be obtained 
as a function of F. We initialize the ecosystem and make 
it evolve according to the following rule: (i) Choose ran- 
domly a single species in the system and mutate the 
chosen species only. Denote x' to be the new config- 
uration, (ii) We compute the entropy change AS = 
S(F(x')) — S(F(x)) after the trial mutation x — > x', and 
accept the mutation when AS < 0; for AS > 0, the 
mutation is accepted with probability exp(— AS). 

In this algorithm, the entropy of the ecosystem is esti- 
mated as follows: Initially the entropy S(F) is set equal 
to zero for all values of the total fitness F. We then ob- 
tain the histogram H(F) of the total fitness for a short 
run, which gives new estimation of S(F): 



S(F) = 



S{F) for H(F) = 

S(F) + In H(F) otherwise. 



(2) 



In this model, the entropy of the system increases if the 
system stays long in configurations with the same value of 
F. Accordingly, the probability for the mutation to make 
the system escape from a region of the same F is higher 
than that for the mutation to have the system stay in that 
region. Accordingly, the total fitness F oscillates in time, 
unless the system falls in a region of the lowest entropy 
at the extrema of F(t) and has difficulty in escaping from 
it. 

For numerical work, N — L 2 species are arranged to 
form either a circular chain or a square array with lin- 
ear size L. We mainly use N — 16 2 in the numerical 
work here. Three kinds of fitness function fi(x) are 
used: One is the Bak-Sneppen (BS) type fitness func- 
tion fi = Xi 0| , which was also employed in Ref . 0. 
The other two are given by 



fi ^ ^ X^Xj/2 



and 
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(3) 



(4) 



respectively, where the prime restricts the summation to 
nearest neighbors of the i-th species. Without knowledge 
of the relevant coupling form, we just consider these fit- 
ness functions representing simplest nontrivial couplings 
between species: While the fitness given Eq. (0 gets 
large for x^s of neighboring species both large, that in 
Eq. Q grows with the difference in x^s between neigh- 
boring species. 

We initialize the system by assigning a random number 
in the interval [1,0) to each Xi. As the system evolves 
according to the entropic sampling algorithm, we obtain 
the time series of the total fitness F(t) and the mutation 
rate R{t), where the unit of time t is taken to be one 
Monte Carlo step per species (MCS) . The mutation rate 
R(t) is defined to be the number of mutations taking 
place between time t— 10 and t, where the time interval 



of ten (instead of unity) is chosen just for convenience, 
in view of the large time scale in fossil data. It is indeed 
confirmed that the overall behavior of the time series 
does not depend on the length of the time interval in 
which R(t) is sampled. Usually we obtain results for 
an ensemble of 20 to 30 sets of species with the same 
lattice type and fitness, and check any dependence of the 
stationary patterns on the initial configuration. 



III. 1// SPECTRUM AND CRITIC ALITY 

It was observed that the avalanche size distribution 
D(s) and the waiting time distribution D(t,„) satisfy 
power laws, with the exponents close to two |ll| . An 
avalanche of size s consists of s mutations, each of which 
is accepted within A trials after the previous mutation. 
In this work we take A = 10, again considering the large 
time scale in fossil data, and confirm that the resulting 
power-law behavior is persistent with the exponent not 
much changing as A is varied. The waiting time t w is 
defined to be the time interval for a certain species or 
for a species of maximum fitness to wait until the next 
mutation occurs. It was then claimed that the obtained 
exponents were compatible with the fossil data. If one of 
the two distributions satisfies a power law, the other also 
satisfies a power law with a similar exponent. Hence we 
present here only the results of the avalanche size distri- 
bution D{s). 

We begin with the BS type fitness function: /$ = Xi 
and show in Fig. ^ long-term behaviors of the (coarse- 
grained) time series F(t) and R(t). At earlier time, both 
F(t) and R(t) oscillate irregularly while the average am- 
plitudes keep increasing. Eventually, the system grows 
into a stationary state, irrespective of the initial config- 
uration. In this regime, the time series R(t) is shown 
in detail in Fig. Ufa), characterized by aperiodic repe- 
titions of relatively dormant periods. Remarkably, the 
power spectrum P(f), computed directly from the time 
series data R(t), exhibits the power-law behavior f~ a in 
frequency /, with the exponent a ~ 1.5, as shown in 
Fig. H£b). It is pleasing that this 1// behavior of the 
power spectrum is indeed consistent with that observed 
in the extinction data 0, 0] . 

When the fitness function is given by Eq. or 
the behavior of the ecosystem appears to depend ap- 
preciably on the spatial dimension of the system. We 
first present the results of the system forming a one- 
dimensional chain. For the fitness function in the form 
of Eq. (|3J), the time series in 19 samples out of the 20 
ones considered are entirely similar to those of the system 
with the BS-type fitness function presented already. Just 
one sample constitutes an exception out of the twenty, 
with the evolution activity stopping for certain periods of 
time; this behavior will be discussed later. The avalanche 
size distribution D(s), shown in Fig. [31 is also similar to 
that in the system with the BS-type fitness. 

In case that the fitness function is given by Eq. 
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FIG. 1: Coarse-grained time series in a system with the fitness 
function fi — xv. (a) total fitness F(t) and (b) mutation rate 
R(t). 

only about 10% of the samples in the set studied evolve 
smoothly into the stationary state without pause. A typ- 
ical time series, shown in Fig. E{a), consists of active 
periods and dormant periods ("pauses"), during which 
mutations do not take place at all. This arises from 
the fact that the system is fallen in a low-entropy re- 
gion and it takes a long time for the system to escape 
from it. Note that this does not happen in the case of 
the BS-type fitness function, for which there is no cou- 
pling between species. In the presence of coupling, the 
system in the state of the minimum of R(t) sometimes 
goes through a kind of frustration in searching the config- 
uration x at which the escape is possible. Such behavior 
can be observed far less frequently in the system with 
the fitness given by Eq. Q instead of Eq. the former 
fitness function tends to make the system more synergic 
for evolution. 

We now go over to the case of a two-dimensional square 
lattice under periodic boundary conditions. In the two- 
dimensional system, even with the fitness in Eq. J3J , only 
about 20 % of the samples in the set are observed to 
grow smoothly into the stationary state without pause. 
Figure E[b) shows the typical time series, where the 
pause duration is in general longer than that in the one- 
dimensional system with the same fitness and sometimes 
mutations may terminate forever. In the case of the 
fitness in Eq. no sample has been found to evolve 
smoothly: The average duration of the pause tends to 



be even longer and the system finally stops evolving. It 
is thus concluded that a two-dimensional system, which 
is more realistic in view of the real ecosystem, tends to 
have dormant periods more often than a one-dimensional 
system, presumably due to the presence of frustration. 

Finally, we briefly mention the effects of shortcuts on 
the evolution activity. Although coupling is expected to 
exist mostly between neighboring species in the ecosys- 
tem, it is also conceivable that some species interact 
via long-range coupling. Such long-range coupling may 
be described by the addition of shortcuts, making the 
ecosystem possess the small- world network structure . 
We have built a small-world network by adding short- 
cuts to the one-dimensional system and investigated the 
evolution of the system. It is found that the evolution 
in most samples tends to become a bit more active as 
shortcuts are added, with the total number of avalanches 
increased up to 5 %. In the systems displaying pause pe- 
riods, on the other hand, the addition of shortcuts may 
enhance or weaken the activity, depending on the initial 
configuration and the positions of shortcuts. 

IV. SUMMARY 

We have studied in detail the information transfer 
model for mass extinction, with three kinds of fitness 
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FIG. 2: (a) Part of the time series R(t) in the fine time scale 
and (b) power spectrum P(f) of the time series data in Fig.0 
exhibiting the power-law behavior f~ a . The straight line cor- 
responds to the exponent a = 1.5. 
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FIG. 3: Avalanche size distribution D(s) in the system with 
the fitness given by fi = Xi (o) and by Eq. © (V). Here D(s) 
has been obtained with A = 10 and the straight line has the 
slope —1.6. 



uration. It is interesting and remarkable that the muta- 
tion rate in the stationary state exhibits a 1 //-like power 
spectrum with the exponent about 1.5, quite similar to 
that of fossil data. 



When interactions between neighboring species are in- 
troduced, the evolution of the system may be either 
largely similar to that of the system in the absence of 
interactions (i.e., with the BS-type fitness) or character- 
ized by active periods separated by dormant ones, de- 
pending on the specific form of the (interacting) fitness 
function. Such pause behavior during evolution has been 
attributed to the presence of frustration in escaping from 
the low-entropy region. In the case that species are lo- 
cated on a two-dimensional lattice, the pause periods ap- 
pear more often regardless of the fitness function, reflect- 
ing the enhancement of frustration. 



function. The behavior of the system evolving into a sta- 
tionary state has been found to depend on the spatial 
dimension of the system as well as the fitness function. 
The system with the BS-type fitness in general evolves 
into a stationary state, irrespective of the initial config- 
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Further, when shortcuts representing long-range inter- 
actions are added in the system, generating small-world 
network structure, the evolution behavior in general de- 
pends on the initial configuration: The overall activity 
of the system may become either stronger or weaker in 
the presence of shortcuts. In particular, in the system 
evolving without pause, the addition of shortcuts tends 
to induce avalanches slightly more. 
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FIG. 4: Coarse-grained time series R(t) (a) of a one- 
dimensional system with the fitness function given by Eq. @ ; 
(b) of a two-dimensional system with the fitness function 
given by Eq. ®. 
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